Improved clustering using deterministic annealing with a gradient descent technique
نویسندگان
چکیده
Various techniques exist to solve the non-convex optimization problem of clustering. Recent developments have employed a deterministic annealing approach to solving this problem. In this letter a new approximation clustering algorithm, incorporating a gradient descent technique with deterministic annealing, is described. Results are presented for this new method, and its performance is compared with the K-means algorithm and a previously used deterministic annealing clustering algorithm. The new method is shown to produce more effective and robust clustering.
منابع مشابه
Data visualization by multidimensional scaling: a deterministic annealing approach
Multidimensional scaling addresses the problem how proximity data can be faithfully visualized as points in a low-dimensional Euclidean space. The quality of a data embedding is measured by a stress function which compares proximity values with Euclidean distances of the respective points. The corresponding minimization problem is non-convex and sensitive to local minima. We present a novel det...
متن کاملMultidimensional Scaling by Deterministic Annealing
Multidimensional scaling addresses the problem how proximity data can be faithfully visualized as points in a low-dimensional Euclidian space. The quality of a data embedding is measured by a cost function called stress which compares proximity values with Euclidian distances of the respective points. We present a novel deterministic an-nealing algorithm to eeciently determine embedding coordin...
متن کاملAn Efficient MRF Image- Restoration Technique Using Deterministic Scale-Based Optimization
• A method for performing piecewise smooth restorations on images corrupted with high levels of noise has been developed. Based on a Markov Random Field (MRF) model, the method uses a neural network sigmoid nonlinearity between pixels in the image to produce a restoration with sharp boundaries while providing noise reduction. The model equations are solved with the Gradient. Descent Gain Anneal...
متن کاملFinding prototypes for nearest neighbour classification by means of gradient descent and deterministic annealing
Abstraet--A new method is presented to find prototypes for a nearest neighbour classifier. The prototype locations are opfimised through a gradient descent and a deterministic annealing process. The proposed algorithm also includes an initialisation strategy which alms to provide the maximum classification rate on the training set with the minimum number of prototypes. Experiments show the effi...
متن کاملV Annealing by Stochastic Neural Networks for Optimization
Two major classes of optimization techniques are the deterministic gradient methods and stochastic annealing methods. Gradient descent algorithms are greedy algorithms, which are subject to a fundamental limitation of being easily trapped in local minima of the cost function. Hopfield networks usually converge to a local minimum of energy function. Because of its deterministic input-output rela...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Pattern Recognition Letters
دوره 15 شماره
صفحات -
تاریخ انتشار 1994